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AMENDMENTS TO THE CLAIMS 

1. (currently amended): A system for use in providing data storage and data copies over a 
computer network, comprising: 

a storage server system comprising one or more data storage servers that each comprise a data 
storage device and a network interface, each of said data storage servers operable to communicate 
over said network interface with at least one application client that will require data storage and at 
least one other data storage server; and 

a data management system comprising at least one data management server operable to (a) 
define at least a first and a second cluster each comprising one or more data storage servers, (b) 
define at least one primary volume of data storage distributed over at least two of said storage servers 
within one of said clusters, said primary volume storing data from the application client, (c) define at 
least one remote volume of data storage distributed over one or more of said storage servers within 
one of said clusters; (d) create snapshots of said primary volume with the creation of a first snapshot 
of said snapshots also causing the establishment of a new laver as the primary volume, said new layer 
containing a pointer to data in said first snapshot ; and (e) copy data firom said snapshots over the 
computer network to said remote volume. 

2. (original): The system for use in providing data storage and data copies over a computer 
network, as claimed in claim 1 , wherein each of said snapshots provides a view of the data stored at 
said primary volume at the point in time of said snapshot. 

3. (original): The system for use in providing data storage and data copies over a computer 
network, as claimed in claim 1, wherein an application client is operable to read data stored in said 
snapshots at said primary volume. 

4. (original): The system for use in providing data storage and data copies over a computer 
network, as claimed in claim 1, wherein an application client is operable to read data stored in said 
snapshots at said remote volume. 
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5. (original): The system for use in providing data storage and data copies over a computer 
network, as claimed in claim 1 , wherein each snapshot includes data that has been modified at said 
primary volume since a previous snapshot of said'primary volume. 

6. (original): The system for use in providing data storage and data copies over a computer 
network, as claimed in claim 5, wherein said snapshots are copied to remote snapshots associated 
with said remote volume. 

7. (original): The system for use in providing data storage and data copies over a computer 
network, as claimed in claim 5, wherein said snapshots are copied from said primary volume to said 
remote volume and at least a second remote volume distributed over one or more of said storage 
servers within one of said clusters. 

8. (original): The system for use in providing data storage and data copies over a computer 
network, as claimed in claim 5, wherein said snapshots are copied from said primary volume to said 
remote volume and at least a second remote volume distributed over one or more of said storage 

• servers within one of said clusters, and wherein the source of said snapshots copied to said second 
remote volume is selected based on at least one of the volume most likely to be available, the least 
loaded volume, the volume with the highest bandwidth cormection to the network, and the volume 
with a least costly cormection to the network. 

9. (original): The system for use in providing data storage and data copies over a computer 
network, as claimed in claim 5, wherein said snapshots are copied from said primary volume to said 
remote volume and are copied from said remote volume to a second remote volume distributed over 
one or more of said storage servers within one of said clusters. 

10. (original): The system for use in providing data storage and data copies over a computer 
network, as claimed in claim 1, wherein said snapshots are created according to a predetermined 
schedule defined by said data management system. 
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11. (original): The system for use in providing data storage and data copies over a computer 
network, as claimed in claim 10, wherein said snapshots are copied to remote snapshots associated 
with said remote volume according to said predetermined schedule. 

12. (original): The system for use in providing data storage and data copies over a computer 
network, as claimed in claim 1 , wherein said data management system is further operable to designate 
said primary volume as a second remote volume that is not able to write data from application clients. 

13. (original): The system for use in providing data storage and data copies over a computer 
network, as claimed in claim 1 , wherein said data management system is further operable to designate 
said remote volume as a second primary volume, said second primary volume storing data from at 
least one application client independently of said primary volume. 

14. (original): The system for use in providing data storage and data copies over a computer 
network, as claimed in claim 13, wherein said remote volume is designated as said second primary 
volume following a failure of said primary volume. 

15. (original): The system for use in providing data storage and data copies over a computer 
network, as claimed in claim 13, wherein said remote volume is designated as said second primary 
volume following a determination by a user to create a second primary volume. 

16. (original): The system for use in providing data storage and data copies over a computer 
network, as claimed in claim 13, wherein said data management system is further operable to 
designate said primary volume as a second remote volume that is not able to write data from 
application clients. 

17. (original): The system for use in providing data storage and data copies over a computer 
network, as claimed in claim 1 6, wherein said data management system is operable to copy data from 
a snapshot of said second primary volume to said second remote volume. 
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18. (original): The system for use in providing data storage and data copies over a computer 
network, as claimed in claim 17, wherein said data management system is operable to generate a 
snapshot of said primary volume prior to designating said primary volume as said second remote 
volume. 

19. (original): The system for use in providing data storage and data copies over a computer 
network, as claimed in claim 18, wherein said data management system is operable to resynchronize 
said primary volume with said second primary volume. 

20. (original): The system for use in providing data storage and data copies over a computer 
network, as claimed in claim 1 , wherein said primary volume comprises a plurality of logical blocks 
of data. 

21. (original): The system for use in providing data storage and data copies over a computer 
network, as claimed in claim 20, wherein each of said plurality of logical blocks of data comprises a 
plurality of physical blocks of data, each physical block of data comprising a unique physical address 

• associated with said data storage device and data to be stored at said unique physical address. 

22. (original): The system for use in providing data storage and data copies over a computer 
network, as claimed in claim 20, wherein said snapshots comprise pointers to logical blocks of data 
stored at said cluster. 

23. (original): The system for use in providing data storage and data copies over a computer 
network, as claimed in claim 20, wherein 

wherein each of said logical blocks of data are copied from said primary volume to said 
remote volume and at least a second remote volume distributed over one or more of said storage 
servers within one of said clusters, and wherein the source of each of said logical blocks of data 
copied to said second remote volume is selected based on at least one of the volume most likely to be 
available, the least loaded volume, the volume with the highest bandwidth connection to the network, 
and the volume with a least costly cormection to the network. 
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24. (original): The system for use in providing data storage and data copies over a computer 
network, as claimed in claim 1, wherein said network interface is adapted to cormect to one of an 
Ethernet network, a fibre channel network, and an infiniband network. 

25. (original): The system for use in providing data storage and data copies over a computer 
network, as claimed in claim 1 , wherein said data management system is operable to copy data from 
said snapshots to said remote volume independently of network protocol. 

26. (original): The system for use in providing data storage and data copies over a computer 
network, as claimed in claim 1 , wherein said data management system is operable to copy data from 
said snapshots to said remote volume independently of network link bandwidth, 

27. (original): The system for use in providing data storage and data copies over a computer 
network, as claimed in claim 1 , wherein said data management system is operable to copy data from 
said snapshots to said remote volume independently of network latency. 

28. (original): The system for use in providing data storage and data copies over a computer 
network, as claimed in claim 1 , wherein said data management system is operable to copy data from 
said snapshots to said remote volume at a selected maximum bandwidth. 

29. (original): The system for use in providing data storage and data copies over a computer 
network, as claimed in claim 28, wherein said selected maximum bandwidth is adaptively set based 
on the network bandwidth capacity and utilization of the network. 

30. (original): The system for use in providing data storage and data copies over a computer 
network, as claimed in claim 28, wherein said selected maximum bandwidth is adjusted based on 
time of day. 

31. (original): The system for use in providing data storage and data copies over a computer 
network, as claimed in claim 1, wherein said first primary volume is located at a first cluster and said 
first remote volume is located at a second cluster. 
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32. (original): The system for use in providing data storage and data copies over a computer 
network, as claimed in claim 31, wherein said first cluster and said second cluster are located at 
different geographic locations. 

33. (original): The system for use in providing data storage and data copies over a computer 
network, as claimed in claim 1, wherein said data management server is a distributed data 
management server distributed over one or more data storage servers. 

34. (original): The system for use in providing data storage and data copies over a computer 
network, as claimed in claim 1 , wherein said data management server is further operable to redefine 
said primary volume to be distributed over one or more data storage servers that are different than 
said at least two data storage servers while copying data from said snapshots over the computer 
network to said remote volume. 

35. (original): The system for use in providing data storage and data copies over a computer 
' network, as claimed in claim 1 , wherein said data management server is further operable to define at 

least one replica volume of data storage distributed over one or more of said data storage servers 
within one of said clusters, said replica volume storing data stored at said primary volume. 

36. (original): The system for use in providing data storage and data copies over a computer 
network, as claimed in claim 35, wherein said data management server is operable to create snapshots 
of said replica volume corresponding to said snapshots of said primary volume, and wherein the 
source of said snapshots copied to said remote volume selected based on at least one of the volume 
most likely to be available, the least loaded volume, the volume with the highest bandwidth 
connection to the network, and the volume with a least costly cormection to the network. 

37. (original): The system for use in providing data storage and data copies over a computer 
network, as claimed in claim 35, wherein in the event of a failure associated with said primary 
volume, said data management server is operable to copy said snapshots from said replica volume to 
said remote volume. 
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38. (original): The system for use in providing data storage and data copies over a computer 
network, as claimed in claim 37, wherein said failure is at least one of a data storage server failure 
and a network failure. 

39. (currently amended): A method for copying data from a primary data storage volume to a 
remote data storage volume in a distributed data storage system, comprising: 

defining a first primary volume of data storage distributed over at least two data storage 
servers within a first cluster of data storage servers, each of said data storage servers comprising a 
data storage device and a network interface; 

generating a first primary snapshot of said first primary volume, said first primary snapshot 
providing a view of data stored at said first primary volume at the time said first primary snapshot is 
generated said first primary snapshot also causing the establishment of a new layer as the primary 
volume, said new layer containing a pointer to data in said first snapshot ; 

creating a first remote volume distributed over one or more data storage servers within a 
cluster of data storage servers; 

linking said first remote volume to said first primary volume; and 

copying data from said first primary snapshot to a first remote snapshot associated with said 
first remote volume. 

40. (original): The method for copying data from a primary data storage volume to a remote 
data storage volume in a distributed data storage system, as claimed in claim 39, further comprising: 

generating a second primary snapshot of said first primary volume, said second primary 
snapshot providing a view of data stored at said first primary volume at the time said second primary 
snapshot is generated; and 

copying data fi-om said second primary snapshot to a second remote snapshot associated with 
said first remote volume. 

41. (original): The method for copying data from a primary data storage volume to a remote 
data storage volume in a distributed data storage system, as claimed in claim 39, wherein said second 
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primary snapshot includes data that has been modified at said first primary volume since said step of 
generating a first primary snapshot. 

42. (original): The method for copying data from a primary data storage volume to a remote 
data storage volume in a distributed data storage system, as claimed in claim 39, further comprising: 

copying data from said first snapshot to a second remote volume distributed over one or more 
storage servers within a cluster of data storage servers. 

43. (original): The method for copying data from a primary data storage volume to a remote 
data storage volume in a distributed data storage system, as claimed in claim 39, further comprising: 

copying said first remote snapshot from said first remote volume to a second remote volume 
distributed over one or more storage servers within a cluster of data storage servers. 

44. (original): The method for copying data from a primary data storage volume to a remote 
data storage volume in a distributed data storage system, as claimed in claim 39, wherein said steps of 
generating first and second primary snapshots are performed according to a predetermined schedule 

' defined by a data management system. 

45. (original): The method for copying data from a primary data storage volume to a remote 
data storage volume in a distributed data storage system, as claimed in claim 39, wherein said steps of 
copying said first and second primary snapshots to said first and second remote snapshots are 
performed according to a predetermined schedule defined by a data management system. 

46. (original): The method for copying data from a primary data storage volume to a remote 
data storage volume in a distributed data storage system, as claimed in claim 39, further comprising: 

designating said first remote volume as a second primary volume, said second primary 
volume storing data from at least one application client independently of said first primary volume. 

47. (original): The method for copying data from a primary data storage volume to a remote 
data storage volume in a distributed data storage system, as claimed in claim 46, wherein said step of 
designating is performed following a failure of said first primary volume. 
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48. (original): The method for copying data from a primary data storage volume to a remote 
data storage volume in a distributed data storage system, as claimed in claim 47, wherein said step of 
designating is performed following a determination by a user to create a second primary volume. 

49. (original): The method for copying data from a primary data storage volume to a remote 
data storage volume in a distributed data storage system, as claimed in claim 48, further comprising: 

designating said first primary volume as a second remote volume that is not able to write data 
from application clients. 

50. (original): The method for copying data from a primary data storage volume to a remote 
data storage volume in a distributed data storage system, as claimed in claim 49, further comprising: 

copying data written to said second primary volume to said second remote volume. 

51. (original): The method for copying data from a primary data storage volume to a remote 
data storage volume in a distributed data storage system, as claimed in claim 49, wherein said step of 

• designating said first primary volume as a second remote volume comprises: 
generating a snapshot of said first primary volume; and 
designating said first primary volume as said second remote volume. 

52. (original): The method for copying data from a primary data storage volume to a remote 
data storage volume in a distributed data storage system, as claimed in claim 49, further comprising 
resynchronizing said second primary volume with said second remote volume. 

53. (original): The method for copying data from a primary data storage volume to a remote 
data storage volume in a distributed data storage system, as claimed in claim 52, wherein said step of 
resynchronizing comprises: 

generating a second primary snapshot of said second primary volume providing a view of data 
stored at said second primary volume at the time said second primary snapshot is generated; 

generating a second remote snapshot of said second remote volume providing a view of data 
stored at said first primary volume at the time said third primary snapshot is generated; 
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copying data that has been modified at said second primary volume to said second remote 
volume. 

54. (original): The method for copying data from a primary data storage volume to a remote 
data storage volume in a distributed data storage system, as claimed in claim 39, wherein said step of 
creating a first remote volume comprises: 

creating a volume at a cluster of data storage servers; 

designating said volume as a remote volume; 

linking said remote volume to said first primary volume; and 

setting a maximum bandwidth at which data may be copied to said remote volume. 

55. (original): The method for copying data from a primary data storage volume to a remote 
data storage volume in a distributed data storage system, as claimed in claim 54, wherein said step of 
setting is based on network bandwidth capacity and network utilization. 

56. (original): The method for copying data from a primary data storage volume to a remote 
• data storage volume in a distributed data storage system, as claimed in claim 54, wherein said step of 

setting comprises: 

scheduling a maximum bandwidth at which data may be copied to said remote volume. 

57. (original): The method for copying data from a primary data storage volume to a remote 
data storage volume in a distributed data storage system, as claimed in claim 56. wherein said step of 
scheduling is based on at least one of time of day and day of the week. 

58. (original): The method for copying data from a primary data storage volume to a remote 

data storage volume in a distributed data storage system, as claimed in claim 39, wherein said data 
management system is a distributed data management server distributed over one or more of said data 
storage servers. 

59. (original): The method for copying data from a primary data storage volume to a remote 
data storage volume in a distributed data storage system, as claimed in claim 39, wherein said 
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primary volume comprises a plurality of logical blocks of data, and wherein said step of generating a 
first primary snapshot comprises moving a pointer associated with each of said plurality of logical 
blocks of data from said primary volume to said first primary snapshot. 

60. (original): The method for copying data from a primary data storage volume to a remote 
data storage volume in a distributed data storage system, as claimed in claim 39, wherein said step of 
copying comprises: 

copying a first portion of said first primary snapshot to said first remote snapshot; 
recording that said first portion has been copied; and 

copying a second portion of said first primary snapshot to said first remote snapshot. 

61. (original): The method for copying data from a primary data storage volume to a remote 
data storage volume in a distributed data storage system, as claimed in claim 60, wherein said step of 
copying a second portion is interrupted, and said step of copying a second portion is re-started based 
on said step of recording. 

62. (original): The method for copying data from a primary data storage volume to a remote 
data storage volume in a distributed data storage system, as claimed in claim 60, wherein the amount 
of data included in said first portion is based on an amount of data contained in said first primary 
snapshot. 

63. (original): The method for copying data from a primary data storage volume to a remote 
data storage volume in a distributed data storage system, as claimed in claim 60, wherein the amount 
of data included in said first portion is determined based on an elapsed time period since starting said 
step of copying a first portion. 
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